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In  this  report,  several  techniques  to  reduce  speckle  noise  (more 
generally  signal  independent  multiplicative  noise)  in  images  are  studied. 
The  techniques  include  gray  scale  modification,  frame  averaging,  low- 
pass  filtering  in  the  intensity  and  density  domain,  and  application  of  the 
short  space  spectral  subtraction  image  restoration  technique  in  the 
density  domain.  Some  discussions  on  the  theoretical  basis  of  the 
techniques  studied  are  given  and  their  performances  are  illustrated  by 
way  of  examples. 
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I. 


Introduction 


The  'speckle  effect'  (1)  is  commonly  observed  in  images  generated  with 
highly  coherent  laser  light.  As  will  be  illustrated  later  (Figure  2),  it 
appears  as  a  multiple  of  tiny  spots  (or  'speckles')  of  varying  intensity, 
superimposed  on  the  true  image.  Although  this  can  be  useful  in  certain 
applications  (2),  speckle  is  generally  regarded  as  a  degrading  effect.  For 
example,  speckle  in  an  optical  radar  system  can  reduce  the  probability  of 
target  detection.  Thus,  the  elimination  of  speckle  is  of  vital  concern  in 
such  systems. 

In  this  report,  we  consider  the  restoration  of  images  degraded  by  a 
multiplicative  noise  model  (3)  for  speckle.  The  restoration  techniques 
that  we  studied  include  gray  scale  modification,  multi-frame  averaging, 
low-pass  filtering  both  in  the  intensity  and  density  (log  intensity)  domain 
and  application  of  the  short-space  spectral  subtraction  image  restoration 
technique  (4)  in  the  density  domain.  As  will  be  illustrated  by  way  of 
examples,  the  techniques  that  we  studied  with  the  exception  of  low-pass 
filtering  are  generally  useful  in  enhancing  images  degraded  by  speckle  noise. 

In  section  II,  we  present  some  statistical  properties  of  speckle 
noise  on  which  the  study  reported  here  is  based.  In  section  III,  we  discuss 
techniques  applied  to  enhance  images  degraded  by  speckle  in  the  case  when 
only  one  frame  of  a  degraded  image  is  available.  The  case  when  more  than 
one  frame  of  a  degraded  image  are  available  for  processing  is  discussed 
in  section  IV. 
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II. 


Statistical  Model  for  Speckle  Noise 


In  this  report,  we  consider  a  model  for  speckle  noise  which  Is  adequate 
when  the  degraded  image  has  been  sampled  coarsely  enough  such  that  the  de¬ 
gradation  at  any  point  can  be  assumed  to  be  Independent  from  all  other  points. 
Specifically,  this  model,  derived  both  theoretically  and  experimentally  (5), 
gives  for  a  point  with  intensity  xfn^.n^  the  corresponding  point  yfnj.n.,) 
in  the  degraded  image  as  an  independent  sample  from  the  following  density: 


p  (y)  =  _ i _ 

y  (  n  j  ,  n  ? )  x(nj,n.,) 


(1) 


where 


u(y)  =  1  for  y  >  0  (2) 

0  otherwise 

From  the  density  of  equation  (1),  speckle  can  be  modelled  (3,6)  as  a  multi¬ 
plicative  noise  wCn^.n^)  such  that 


y  (n^  ,n^)  =  x(nj,n9)  •  w(n^  ,n.,) 


(3) 


where 


P  ,  .(w) 

w(nj ,n0) 


-w 

e 


u(w) 


(4) 


With  this  model  for  speckle,  It  can  be  shown  that  the  average  of  N 
frames  of  the  same  image  degraded  by  independent  speckle  for  each  frame 
is  the  maximum  likelihood  estimate  (MLE)  of  the  undegraded  image.  Furthermore, 
the  N  frame  average  can  also  be  modelled  as  the  original  image  degraded  by 
a  multiplicative  noise.  Let  y^(n  •  •  »yn(ni,n  )  be  the  respective  observed 

values  of  an  undegraded  pixel  xfn^.n^)  in  N  independently  degraded  images. 

<yi.y2 . yNJ 

Then  the  joint  density,  P  ,  .  ,  .  is  given  by 

y1(n1,n2)  ’ '  ‘  ’  ,y'rni  ,n2> 
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From  equation  (9),  the  MLE  x(nj,n0)  or  yVn^.n^)  can  also  be  modelled  by  the 
noise-free  Image  x(nj*n.,)  degraded  by  multiplicative  noise  w'fnj.n^).  From 
equation  (10),  if  only  a  single  frame  is  available  such  that  N*1  , 
w'(nj,n.,)  equals  w(nj,n0)  in  equation  (A)  and  y'(nj,n,,)  equals  y(n^,n2). 

From  equations  (3)  and  (9),  it  follows  that  if  yCnj.n^)  or  y'  (n^.n.,) 
is  logarithmically  transformed  such  that 

log  yO^.n.,)  =  log  xinj.n,)  +  log  w(nj,n9)  (11) 

and  log  yVnj.n.,)  =  log  xfn^.n^)  +  log  w'(n  ,n.,)  ,  (12) 

the  noise  component  of  log  w(iij,n0)  or  log  w'(nj,n0)  is  an  additive  one. 
Image  restoration  techniques  such  as  a  spectral  subtraction  technique  (A) 
require  the  knowledge  of  the  second  order  statistics  of  additive  noise. 
Results  on  the  statistics  for  logarithmically  transformed  speckle  (3)  are 
summarized  below. 

(Rl)  For  a  single  speckle  frame,  the  mean  and  variance  of  log  w(nj,n.,)  are 
given  by 

m  =  Euler's  constant  ■  0.577... 
a2  =  tt  2  /  6  =  1.6A 

(R2)  For  N  speckle  frames  that  are  averaged,  the  mean  of  log  w'(n  ,n.,)  is 
the  same  as  in  (Rl)  and  the  variance  of  log  w'(n  .n.,)  for  N  1  can  be 
approximated  by 


A 


O2  =  1/N 


(R3)  It'  I)  Is  the  mean  intensity  of  the  logarithm  of  the  speckle  Image  and 
slgnal-to-noise  ratio  Is  defined  as 

S/N  -  20  log  D/o2 

then  S/N  is  on  the  order  of  0  to  1  dR  for  most  speckle  images. 

(R4)  For  N  averaged  speckle  frames 
S/N  -  20  log  (I)  ►'N) 

These  statistics  of  speckle  were  used  for  generating  degraded  images  as 
well  as  choosing  appropriate  parameters  for  the  restoration  techniques. 

The  rest  of  this  report  describes  these  techniques  and  the  results  obtained 
from  them. 
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Techniques  t  o r  Re due t i on  of  Speckle  Noise:  Single  Frame  Case 

In  this  section,  we  discuss  various  techniques  that  we  have  studied  to 
enhance  images  degraded  by  speckle  noise  when  only  one  frame  of  speckle 
image  is  available  for  processing.  The  techniques  that  we  have  considered 
are  gray  scale  modification,  low-pass  filtering  in  the  intensity  and  density 
domains  and  short  space  spectral  subtraction  in  the  density  domain  and  they 
are  discussed  in  sections  II1.1,  111.2  and  III. 3,  respectively. 

1.  ('.ruv  Scale  Modification 

To  illustrate  a  basis  for  gray  scale  modification,  the  histograms  of 
an  original  image  and  the  same  image  degraded  bv  artificially  generated 
speckle  noise  are  shown  in  Figures  1(a)  and  1(b).  From  the  figures,  it  can 
be  seen  that  speckle  noise  tends  to  shift  the  image  to  a  darker  side  in 
the  luminance  domain,  and  the  overall  brightness  of  an  image  degraded  by 
speckle  noise  is  generally  much  darker  than  the  original  image.  A  common 
technique  used  to  correct  such  a  problem  is  some  form  of  gray  scale 
modification  (7,8).  In  Figure  1(c)  is  shown  a  threshold  clipping  technique 
for  gray  scale  modification  and  in  Figure  1(d)  is  shown  the  histogram  of  an 
image  obtained  by  modifying  the  gray  scale  of  the  image  shown  in  Figure  1(c). 
Tn  general,  we  have  found  that  a  simple  gray  scale  modification  improves 
the  quality  of  both  unprocessed  and  processed  images  and  consequently  will 
be  used  in  illustrating  all  the  examples  in  this  report. 

2.  Low-pass  Filtering 

From  equations  (3)  and  (4),  speckle  noise  can  be  modelled  by  an 
independent  multiplicative  noise  w(n. ,n,).  Since  speckle  noise  at  a  point 
In  space  is  assumed  to  be  statistically  independent  of  any  other  points,  the 
multiplicative  noise  w(n  .n.,)  is  wide  band  random  noise.  Suppose  we 
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Fig.  l(a-d).  (a)  Histogram  of  a  noise-free  image  (a  picture  of  a  clock) 

(b)  Histogram  of  the  same  image  of  Fig.  1(a)  degraded  by  speckle  noise. 

(c)  A  gray  scale  modification  technique  by  threshold  clippling.  (d)  His 
togram  of  the  degraded  image  of  Fig.  1(b)  enhanced  by  the  gray  scale 
modification  technique  of  Fig.  1(c). 


decompose  the  noise-free  image  x(nj,n0)  into  two  components,  one  obtained  by 
low-pass  filtering  and  the  other  obtained  by  high-pass  filtering  so  that 

xfn^.n.,)  =  (n  i  ,  n., )  +  xH(n  ,n2)  (13) 

where  x  and  x  represent  the  components  obtained  by  low-pass  filtering  and 
L  H 

high-pass  filtering  respectively.  Similarly,  w(nj ,n.7)  can  be  decomposed  into 
two  components  such  that 

w(nj,n,)  =  w  (n^n  )  +  wH(nj,n2)  .  (14) 

Combining  equations  (6),  (13)  and  (14), 

v(n1,n2)  =  Xj  (nJ  ,n0)  •w[  (ni  ,n2)  +  (n^n^-v^nj.n,) 


+xH(n1,n.>)-w]  (nj  ,n2)  +  xH(n1  ,n?)  •wH(n1  ,n0)  .  (15) 

Qualitatively  speaking,  from  equation  (15)  low-pass  filtering  y(n^,n9) 
approximately  leads  to  x^(n  ,n^) -Wj  (n^ ,n2) .  Since  the  image  x(n^,n2) 
generally  has  large  amplitude  low-frequency  components  relative  to  high- 
frequency  components  while  speckle  noise  w(n^,n2)  is  wide-band  random  noise, 
low-pass  filtering  v(n^,n^)  may  be  viewed  as  an  operation  that  attempts  to 
improve  the  S/N. 

We  have  applied  various  different  types  of  low-pass  filters  to  y(n^,n^). 
In  general,  the  lower  the  cut-off  frequency,  the  more  speckle  noise  appears 
to  be  reduced,  but  at  the  same  time,  the  resulting  image  is  noticeably  blurred. 
As  an  example  of  low-pass  filtering  to  reduce  speckle  noise,  in  Figure  2  are 
shown  two  noise-free  images.  In  Figure  3  are  shown  the  two  images  in  Figure  2 
degraded  by  artifically  generated  speckle  noise  and  in  Figure  4  are  shown 
the  two  images  in  Figure  3  processed  by  low-pass  filtering. 


8 


P-250-2166A 


o  no  iso 


1  procossoil  !>v  low-pass  filtoriiiR  in  tin’ 


1  Hi  Ji.iil  NO  lAlih.  hi  Jit* 


In  the  above  discussions,  we  have  considered  low-pass  filtering  in  the 
intensity  domain.  Low-pass  filtering  in  the  density  domain  also  has  a 
theoretical  basis.  Specifically,  from  equation  (11),  speckle  noise  is  an 
additive  component  in  the  density  domain.  For  typical  images,  log  x(n^,n2) 
has  large  amplitude  low-frequency  components  relative  to  high-frequency 
components  while  the  additive  component  log  w(n1,n.,)  is  wide-band  random 
noise.  Therefore,  low-pass  filtering  log  yCn^.n^)  generally  reduces 
log  w(n^,n2)  nore  than  log  xCn^,^)  thus  leading  to  a  S/N  improvement. 
Filtering  in  the  density  domain  so  that  the  multiplicative  component 
becomes  an  additive  component  is  known  as  homomorphic  filtering  (9). 
Homomorphic  filtering  to  reduce  speckle  noise  has  been  considered  in  (6,10). 

We  have  applied  various  different  types  of  low-pass  filters  to 
log  y(n^,n2)  and  as  a  typical  example  the  two  images  in  Figure  3  processed 
by  low-pass  filtering  in  the  density  domain  are  shown  in  Figure  5.  Like 
low-pass  filtering  in  the  intensity  domain,  we  have  found  that  speckle 
noise  is  reduced  but  the  resulting  images  are  noticeably  blurred.  Due  to 
the  high  degree  of  image  blurring  relative  to  the  amount  of  speckle  noise 
reduction,  low-pass  filtering  in  the  density  or  intensity  domain  does  not 
appear  to  be  a  useful  technique  in  practical  applications. 

3.  Short  Space  Spectral  Subtraction  Technique 

Since  speckle  noise  can  be  modelled  by  an  additive  random  noise  in 
the  density  domain,  in  addition  to  simple  low-pass  filtering,  there  exists 
a  variety  of  other  restoration  techniques  such  as  Wiener  filtering  (11,12) 
and  power  spectrum  filtering  (13)  that  may  be  applied  to  reduce  the 
additive  random  noise.  One  technique  which  has  been  particularly  successful 
in  reducing  additive  random  noise  at  relatively  high  S/N  is  short  space 
spectral  subtraction  image  restoration  (SSIR)  technique*.  This  technique 
requires  only  the  knowledge  of  the  power  spectrum  of  the  additive  random 


*  A  brief  description  of  this  technique  is  given  in  the  Appendix.  A  more 
detailed  discussion  can  be  found  in  (4). 
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noise.  The  additive  noise  log  wCn^.n^)  is  broad-band  and  its  spectral 
amplitude  can  be  determined  from  (Rl).  In  Figure  6  are  shown  the  two 
images  in  Figure  3  processed  by  short  space  SSIR  technique.  It  is  clear 
from  Figure  6  that  speckle  noise  is  reduced  without  noticeably  blurring 
the  image.  However,  the  remaining  degradation  looks  like  a  moire^  pattern 
superimposed  on  the  original  image.  Informal  tests  show  that  improvement 
in  image  quality  by  such  processing  is  debatable.  This  result  is  partly 
due  to  the  fact  that  there  is  no  known  algorithm  which  effectively  enhances 
images  degraded  by  additive  random  noise  at  a  very  low  S/N  such  as  0  or  ldB. 
When  the  S/N  is  increased  by  frame  averaging,  a  more  promising  result  is 
obtained  as  will  be  discussed  in  the  next  section. 
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Images  in  Fig.  3  processed  by  low-pass  filtering  in  the 
density  (log  intensity)  domain 


Images  in  Fig.  3  processed  by  a  short  space  spectral 
subtraction  image  restoration  technique 
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IV.  Techniques  for  Reduction  of  Speckle  Noise:  Multiple  Frame  Case 

When  N  frames  of  the  same  image  but  with  independent  speckle  noise  are 
available  for  processing,  the  MLE  of  the  noise-free  image  is  the  average  of 
N  frames  given  by  equation  (7).  The  frame  averaging  technique  to  reduce 
speckle  noise  has  been  considered  in  (2,14).  In  Figure  7  are  shown  y'fn^.n^), 
the  results  of  averaging  four  frames  of  independently  degraded  speckle 
images  of  Figure  3.  Consistent  with  the  theroetical  results  of  (Rl)  -  (R4), 
comparison  of  Figures  3  and  7  clearly  shows  that  frame  averaging  increases 
the  S/N  and  improves  the  image  quality  and  intelligibility. 

From  equations  (9)  and  (10),  y'fn^.n^),  the  result  obtained  by  frame 
averaging,  can  again  be  viewed  as  an  image  degraded  by  a  broad-band  multi¬ 
plicative  noise.  Consequently,  all  the  techniques  discussed  in  section  III 
may  be  applied  to  further  reduce  speckle  noise. 

We  have  applied  various  different  types  of  low-pass  filters  to  y'(nltn2) 
both  in  the  intensity  and  density  domains.  As  a  typical  example  of  low-pass 
filtering  applied  to  y'(n^,n2),  in  Figure  8  are  shown  two  images  in  Figure  7 
processed  by  low-pass  filtering.  The  results  obtained  by  low-pass  filtering 
in  the  density  domain  are  shown  in  Figure  9.  As  in  the  single  frame  case 
discussed  in  section  III,  we  have  found  that  low-pass  filtering  reduces  the 
multiplicative  noise  but  at  the  same  time  noticeably  blurs  the  resulting  images. 

We  have  also  applied  short  space  SSIR  technique  to  log  y' (0^,02)  with 
the  spectral  amplitude  of  log  w'(n^,n2)  obtained  from  (R2)  and  (R4).  The 
results  are  shown  in  Figure  10.  Even  though  the  signal  correlated  degradation 
that  looks  like  a  moire”^ pattern  is  still  visible  in  the  figure,  the  amplitude 
of  the  degradation  is  smaller  and  is  not  too  apparent  in  those  regions  without 
uniform  intensity.  Furthermore,  reduction  of  the  multiplicative  noise  without 
noticeably  blurring  the  image  is  evident  in  the  figure.  This  is  consistent 
with  the  result  (4)  that  short  space  SSIR  technique  is  more  effective  in 
restoring  images  degraded  by  additive  random  noise  at  relatively  high  S/N. 
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As  an  additional  example,  we  have  considered  the  case  when  eight  frames 
of  independently  degraded  speckle  images  are  available  for  processing. 

Figures  11,  12,  13  and  14  are  equivalent  to  Figures  7,  8,  9  and  10  with  the 
difference  that  eight  frames  rather  than  four  frames  have  been  used.  Our 
discussions  in  the  four  frame  case  are  also  applicable  to  the  eight  frame  case 
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Results  of  averaging  four  frames  of  independently  degraded 
speckle  images  of  Fig.  3 


Fig.  8.  Images  in  Fig.  7  processed  by  low-pass  filtering  in  the 
intensity  domain 
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Images  in  Fig.  7  processed  bv  low-pass  filtering  in  the 
density  domain 


Images  in  Fig.  7  processed  by  a  short  space  spectral 
subtraction  image  restoration  technique 
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Results  of  averaging  eight  frames  of  independently 
degraded  speckle  images  of  Fig.  3 


Fig.  12.  Images  in  Fig.  11  processed  by  low-pass  filtering  in  the 
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Images  in  Fig.  11  processed  by  low-pass  filtering  in  the 
density  domain 


Images  in  Fig.  11  processed  by  a  short  space  spectral 
subtraction  image  restoration  technique 
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V. 


Conclusion 


In  this  report,  we  have  considered  the  problem  of  restoring  images 
degraded  by  speckle  noise.  The  specific  techniques  that  we  have  studied 
are  gray  scale  modification,  frame  averaging,  low-pass  filtering  in  the 
intensity  and  density  domain,  and  short  space  SSIR  technique  in  the  density 
domain . 

In  general,  some  form  of  gray  scale  modification  has  been  found  to  be 
useful  in  enhancing  images  degraded  by  speckle  noise.  If  only  one  frame 
of  speckle  image  is  available,  then  neither  low-pass  filtering  nor  short 
space  SSIR  technique  has  been  found  to  be  effective  in  restoring  images 
degraded  by  speckle  noise.  When  multiple  frames  of  speckle  images  are 
available  for  processing,  frame  averaging  which  corresponds  to  the  maximum 
likelihood  estimation  of  the  noise-free  image  has  been  quite  effective  in 
increasing  the  S/N  and  improving  the  image  quality  and  intelligibility. 
Furthermore,  the  short  space  SSIR  technique  applied  to  the  results  of  frame 
averaging  appear  to  have  some  usefulness  in  further  reducing  the  degradation. 
Low-pass  filtering,  however,  does  not  appear  to  be  useful  in  the  multiple 
frame  case. 
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APPENDIX.  Short  Space  Spectral  Subtraction  Image 
Restoration  Technique 


In  the  short  space  SSIR  technique,  the  degraded  image  rCn^.n^)  is 
divided  into  many  subimages  each  of  which  is  restored  separately  and  then 
the  restored  images  are  combined  to  form  an  estimate  of  the  noise-free 
image  fCn^n^.  More  specifically,  let  rfa^n  )  be  represented  by 

r(n1,n2)  =  f(nrn2)  +  d^.n^  (Al) 

where  d(n^,n2)  denotes  an  additive  random  noise  uncorrelated  with  f(n^,n2>. 
By  applying  a  2-D  window  function  w^Cn^n^  to  equation  (Al), 

r(n1,n2)  .  w1j(n1>n2)  =  fCn^n^  •  w^tn^n^  +  dfr^.n^  •  w  (n^n^  .  (A2) 
Rewriting  equation  (A2), 

fij  ^ni’n2^  ~^ij (ni> n2^  (A3) 

where  r1j(n1»n2)  represents  rCn^n^  •  wij(n1>n2),  and  f1j(n1»n2>  and 
dij(ni>n2)  are  similarly  defined.  To  estimate  the  noise-free  subimage 
fij  ("i  ,n2>  from  rij  (ni,n2^  ln  e<Iuatlon  (A3),  Fij  (^.u^) ,  the  discrete 
space  Fourier  transform*  of  f^j(n^,n2),  is  first  estimated  and  then  inverse 

*The  definition  of  discrete  space  Fourier  Transform,  power  spectrum  and 
energy  spectrum,  and  the  determination  of  the  normalization  constant  "k" 
can  be  found  in  references  (A)  and  (15). 
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Fourier  transformed.  The  discrete  space  Fourier  transform  is 

estimated  by  a  particular  form  of  spectral  subtraction  (6); 

Fij(tJJl,a)2)  =  (lRij(“1.w2)|2-  a.k-Pd(ultu)2))1/2  •  ej  ^i^V'V  (A4) 

2 

for  | |  _>  a -k-Pd 

and  0  otherwise 

A 

where  represents  an  estimate  of  F  (u^.u^) ,  R^  rePresents 

the  discrete  space  Fourier  Transform  of  r^tn^,^),  <  R^  (u^.u^)  represents 
the  phase  of  R  (ui^,(u^) ,  "a"  is  a  constant,  "k"  is  a  scaling  factor  that 
normalizes  the  power  and  energy  spectral  densities,  and  P.^^.u^)  represents 
the  power  spectrum  of  the  additive  random  noise.  From  the  estimated 
f  i  (ni»n2>  •  an  estimate  of  ffn^,^)  is  obtained  by  combining  the  restored 
subimages ; 

/\  /v 

f (n^.n^)  =  E  E  f1j(n1>n2^  (A5) 

*  i  j  /, 

where  represents  the  estimated  f  <nl  *  n2)  an<*  ^^n]_»n2^  ls  simllarly 

defined. 

In  implementing  the  short  space  SSIR  technique,  in  this  report,  a 
separable  2-D  triangular  window  of  size  16  x  16  pixels  overlapped  with  its 
neighboring  window  by  half  the  window  duration  in  each  dimension  was  used 
for  w^j (n^,n2)  and  the  value  of  "a"  was  assumed  to  be  approximately  1/2. 
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